home *** CD-ROM | disk | FTP | other *** search
/ MacFormat España 14 / MacFormat n. 14 (Spain) / MacFormat 14.bin / Shareware Internet / Internet / NetPresenz-401 / CGI Examples / robots.txt < prev   
Encoding:
Text File  |  1996-01-30  |  224 b   |  10 lines
  1. # robots.txt file
  2. # 
  3. # purpose to World Wide Web Robots trawling your web site (or parts thereof)
  4. # 
  5. # For more info consult:
  6. #   http://info.webcrawler.com/mak/projects/robots/norobots.html
  7.  
  8. User-agent: *
  9. Disallow: /local/
  10.